Assessing Information Transmission in Data Transformations with the Channel Multivariate Entropy Triangle

Data transformation, e.g., feature transformation and selection, is an integral part of any machine learning procedure. In this paper, we introduce an information-theoretic model and tools to assess the quality of data transformations in machine learning tasks. In an unsupervised fashion, we analyze the transformation of a discrete, multivariate source of information (X) over bar into a discrete, multivariate sink of information (Y) over bar related by a distribution P-(XY) over bar. The first contribution is a decomposition of the maximal potential entropy of ((X) over bar, (Y) over bar), which we call a balance equation, into its (a) non-transferable, (b) transferable, but not transferred, and (c) transferred parts. Such balance equations can be represented in (de Finetti) entropy diagrams, our second set of contributions. The most important of these, the aggregate channel multivariate entropy triangle, is a visual exploratory tool to assess the effectiveness of multivariate data transformations in transferring information from input to output variables. We also show how these decomposition and balance equations also apply to the entropies of (X) over bar and (Y) over bar, respectively, and generate entropy triangles for them. As an example, we present the application of these tools to the assessment of information transfer efficiency for Principal Component Analysis and Independent Component Analysis as unsupervised feature transformation and selection procedures in supervised classification tasks.This research was funded by he Spanish Government-MinECo projects TEC2014-53390-P and TEC2017-84395-P

The Case for Shifting the Rényi Entropy

We introduce a variant of the Rényi entropy definition that aligns it with the well-known Hölder mean: in the new formulation, the r-th order Rényi Entropy is the logarithm of the inverse of the r-th order Hölder mean. This brings about new insights into the relationship of the Rényi entropy to quantities close to it, like the information potential and the partition function of statistical mechanics. We also provide expressions that allow us to calculate the Rényi entropies from the Shannon cross-entropy and the escort probabilities. Finally, we discuss why shifting the Rényi entropy is fruitful in some applications.This research was funded by the Spanish Government-MinECo projects TEC2014-53390-P and TEC2017-84395-P

Supporting scientific knowledge discovery with extended, generalized Formal Concept Analysis

In this paper we fuse together the Landscapes of Knowledge of Wille's and Exploratory Data Analysis by leveraging Formal Concept Analysis (FCA) to support data-induced scientific enquiry and discovery. We use extended FCA first by allowing K-valued entries in the incidence to accommodate other, non-binary types of data, and second with different modes of creating formal concepts to accommodate diverse conceptualizing phenomena. With these extensions we demonstrate the versatility of the Landscapes of Knowledge metaphor to help in creating new scientific and engineering knowledge by providing several successful use cases of our techniques that support scientific hypothesis-making and discovery in a range of domains: semiring theory, perceptual studies, natural language semantics, and gene expression data analysis. While doing so, we also capture the affordances that justify the use of FCA and its extensions in scientific discovery.FJVA and AP were partially supported by EUFP7 project LiMo- SINe (contract288024) for this research. CPM was partially supported by the Spanish Ministry of Economics and Competitiveness projects TEC2014-61729-EXP and TEC2014-53390-P

The Socio-economic Impact of Social Computing: Proceedings of a Validation and Policy Options Workshop

This report presents the major outcomes of a validation and policy options workshop on social computing, held at IPTS in Seville, on 26-27 February 2008. It points to a number of relevant issues (including methodological and conceptual ones) that need to be taken into account in a study of the socio-economic impacts of social computing. It argues that there is little room for direct policy interventions in social computing but that framework conditions and impacts at sector-level (e.g. education, government) need to be considered. The report also discusses the future of social computing and the opportunities it offers Europe.JRC.J.4-Information Societ

The Impact of Social Computing on the EU Information Society and Economy

This report provides a systematic empirical assessment of the creation, use and adoption of specific social computing applications and its impact on ICT/media industries, personal identity, social inclusion, education and training, healthcare and public health, and government services and public governance.JRC.J.4-Information Societ

Oportunidades y Retos de la Web 2.0 para la Salud: Blogs (Opportunities and Challenges of the Web 2.0 for Health: Blogs).

Desde que en el año 2004 Tim O´Reilly acuñara el término Web 2.0, numerosos autores han estudiado su utilidad potencial en los temas relacionados con la salud. Dada la amplitud del mundo de la salud y la importancia de las tecnologías de la información y la comunicación, el impacto de la Web 2.0 es potencialmente muy profundo y diverso. Así, se han investigado aspectos tan diversos como el efecto en las profesiones sanitarias, las cualidades terapéuticas de ciertas aplicaciones o el desarrollo de las redes sociales como grupos de apoyo. En cualquier caso, algo esta cambiando. La Web 2.0 ó Computación Social, término este último más clarificador, no es únicamente un conjunto de nuevas aplicaciones que permite la generación fácil de contenidos por todos y cada uno de los usuarios, sino que es fundamentalmente una nueva actitud. Los usuarios ya no son únicamente receptores de información, cada vez más son los co-creadores del contenido. Qué utilidades ofrecerá, qué potencial efecto tendrán en el mundo de la salud estas aplicaciones, e incluso, cómo están ya cambiando la percepción de todos los involucrados en la salud, son nuestras cuestiones de partida.JRC.J.4-Information Societ

ICT for Health: Social Computing

A question of extraordinary interest for the active ageing paradigm is the importance given to preventive medicine and the promotion of healthy lifestyles. In this sense, we consider that Social Computing is a very good example since its potential is enormous and needs to be further explored. It is obvious that ICT technologies, in general, facilitate the wider and quicker dissemination of healthy lifestyles and the prevention of dangerous habits. However, what is the added value offered by Web 2.0 applications, and how have Internet users¿ attitudes changed? And more specifically, what are the advantages for older citizens? Social computing: 1) facilitates the fast dissemination of preventive health measures and of healthy ways of living; 2) shortens the sometimes long wait for an appointment with a health professional; 3) facilitates the personalisation of health-related information making it more realistically accessible by posting reminders to patients of their periodic clinical examinations or seasonal vaccinations and 4) provides information adapted to the level of disability or the physical limitations.JRC.J.4-Information Societ

Additional file 4 of Interactive knowledge discovery and data mining on genomic expression data with numeric formal concept analysis

CSV file of GO terms’ information for gene enrichment from WebGeneKFCA. A sample print-out from WebGeneKFCA with the information about the GO terms and their p-values computed as described in http://www.biomedcentral.com/content/supplementary/10.1186/s12859-016-1234-z-S2.pdfAdditional file 2 for the bicluster with intent MalePS, Parental NoDox, Clone 1 NoDox and Clone 3 NoDox from Fig. 4. It can also be obtained on-line at https://webgenekfca.com/webgenekfca/kfcaresultses/9 . (CSV 24 kb

Information and Communication Technologies for Active Ageing: Opportunities and Challenges for the European Union

The aim of this book is to summarize the current debate on the key elements of ageing societies (Section A) and to link it to Information and Communication Technologies (ICT) for active ageing (Section B) by using an application/policy field approach as an overall framework. ICT-based applications were chosen as a particular focus since they offer a number of very promising applications for active ageing in policy fields like health, learning, employability and housing. The book also aims to stimulate further scientific discussions in this field. Its key question is how to tackle the challenges and exploit the opportunities offered by ageing societies by using the suggested research approach of ICT for active ageing (ICT4AA). This approach is discussed in detail in Section B. We believe that it is complementary to other concepts for active ageing like healthy nutrition, sports and recreational health.JRC.J.4-Information Societ